10/586502 
IAP11 Rec'd PCT/PTO 17 JUL 2000 



Patent 



IN THE UNITED STATES PATENT AND TRADEMARK OFFICE 



Application No. 
Application of 
Date Filed 
Examiner 
TC/A.U. 
Docket 
Customer No. 
Title 



Filed Herewith Confirmation No. Filed Herewith 

GERN, et al. 

Filed Herewith 

Filed Herewith 

Filed Herewith 

3926-199 

30448 

PROCESS AND DEVICE FOR AVOIDING COLLISION 
WHILE OPENING VEHICLE DOORS 



SUBSTITUTE SPECIFICATION 



|\VP320I01;1| 



Express Mail Label No. EV 739330421 US 



WP18Rec*dPCT/PT0 17 JUL 200* 
10/586502 

Attorney Docket No. 3926- 1 99 Patent Application 

METHOD AND DEVICE FOR AVOIDING COLLISIONS WHEN 
OPENING VEHICLE DOORS 

BACKGROUND OF THE INVENTION 

Field of the Invention 

[0001] The invention concerns a process and device for avoiding collisions when 

opening vehicle doors. 

Description of Related Art 

[0002] When opening the doors of a vehicle, there is always the danger of collision with 

stationary obstacles, which are not visible to vehicle occupants, or with moving objects, which 
approach the vehicle without being observed. To address this problem, environment sensor 
systems and driver safety systems are increasingly employed. These systems include distance 
warning, parking aids and backing up aids and total angle detection systems as well as separation 
sensors for indicating the distance of objects in the environment of the vehicle. The sensing of 
the environment of the vehicle occurs using ultra-sound sensors, near- and long-range radar, 
lidar, or with cameras with other adaptive optic sensors. A combination of multiple sensors may 
also be employed. 

[0003] DE 102 61 622 Al describes a process and a device for door collision warning in 

a motor vehicle. Objects are detected in the lateral rear area of the vehicle, the distance and 
speed of the objects is determined, and based on the object speed and the distance to the vehicle, 
a warning distance is calculated. As soon as the object distance becomes smaller than the 
warning distance which is a function of the object's speed, a warning signal is generated. In the 
case of rapidly moving objects, the warning signal is already initiated at greater distances than in 
the case of slowly approaching objects. A change in the speed or direction of the object is 
however not calculated. 

[0004] DE 100 04 161 A 1 discloses a door safety system, in which the opening of the 

vehicle door is blocked or released depending upon the vehicle environment situation as detected 
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by sensors. If a stationary object is in the pivot area of the vehicle door, an acoustic warning is 
emitted. If the monitoring devices associated with the door safety system detect that a moving 
object is approaching, a warning is emitted in the case that the object is an area, in which the 
pivot area of the door defines at the same time a certain safety area. Accordingly, a stationary 
area of the vehicle is monitored. 

[0005] A process and a device for recognition of danger is known from DE 10229033. 

Environment sensors detect objects in the detection area about the vehicle and produce there 
from spacing signals, from which, during movement of the vehicle distance to detected objects is 
determined. In the case of a stationary vehicle, it is determined from these spacing signals, 
whether a danger of collision exists between an opened door and an object. For this, both the 
position of the object as well as the speed are determined and from this the trajectory of the 
object is ascertained. If the trajectory falls within a minimum separation to the pivot area of the 
vehicle door, a warning signal is emitted. The minimum distance to the pivot area of the vehicle 
door is a static value. It must be larger than 0 in order to obtain a safety area. 

[0006] The known processes have in common, that the position and movement changes 

of the vehicle as well as the objects are not sufficiently taken into consideration. 

[0007] It is thus the task of the present invention, to provide a process and a device for 

avoidance of collisions during opening of vehicle doors, which take into consideration changes 
of the environment situation of the vehicle on the basis of movement of the vehicle and the 
detected objects and reliably allow avoidance of collision of vehicle doors with these objects. 

[0008] The task is solved in accordance with the invention by a process according to the 

first patent claim and by a device according to patent claim 10. Preferred embodiments of the 
invention are the subject to the dependent claims. 

SUMMARY OF THE INVENTION 

[0009] According to the inventive process a foreseeable track of movement of a vehicle 

is determined. In a further step the objects in the environment of the vehicle are detected and a 
projected movement trajectory of each of the detected objects is determined. The probability 
space of the pivot area of the vehicle doors are respectively compared with the individual 
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probability spaces of the objects, in order to determine whether an overlapping exists. If an 
overlapping is detected, then a reaction signal indicating a danger of collision is produced. 

[0010] The track of movement of the vehicle is determined from the sensor data collected 

by the vehicle, which are data, are provided by vehicle sensors. The vehicle sensors detect 
vehicle data such as, for example, wheel RPM signals, speed signals, steering wheel angle, 
vehicle position, yaw angle, yaw rate, and longitudinal or transverse acceleration. Beyond this, 
resort can also be made to digital sources such as for example, digital maps and GPS 
information, so that the vehicle position can also include other information such as for example, 
traffic lights, cross walks, bicycle paths or streetcar tracks. The data from individual sensors can 
be combined with each other without restriction in order to determine as precisely as possible the 
movement path of the vehicle. 

[0011] The information for recognition of objects in the environment of the vehicle is 

obtained from environment sensors, which often are already in place in vehicles. 
Advantageously, sensor data is employed which is produced by near-range radar, long-range 
radar, ultra-sound sensors, lidar sensors or cameras. The individual sensor data can be freely 
combined with each other in order to recognize objects in the near or distant environment of the 
vehicle. From the sensor data it is possible to detect, besides the position, also the direction of 
movement, acceleration and speed of the objects. Beyond this, information regarding the track 
of the road and the road edges are available. From these data, the projected movement path for 
the detected objects is determined. 

[0012] Preferably, the movement paths are obtained from the past data and the present 

sensor data and extrapolated into a pre-determined future time t x . The extrapolation time t x can 
be predetermined or could be varied depending upon on employed environment sensor or the 
vehicle speed. 

[0013] In accordance with the invention, a danger of collision can be determined, when 

the overlap of the probability space of the sensor areas of the vehicle doors overlaps with the 
probability space of the detected objects. The probability space is respectively the expected 
projected occupation space for the vehicle or, as the case may be, the pivot areas of the vehicle 
doors and for the objects at a certain point of time t,. The extrapolation of the movement path is 
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carried out between the point in time to, which represents the present position of the object or, as 
the case may be, vehicle, and up to a certain extrapolation point t x . Thereby a very precise 
prediction of a possible collision danger between a moving vehicle and a moving object is made 
possible. 

[0014] If, for example, the curved track of approaching objects crosses the movement 

path of the moving vehicle, then a danger of collision exists, but only then, when the intersection 
of the paths exists at the same time. The same applies with respect to the possible occupation 
spaces or, as the case may be, the time dependent probability space. No collision danger exists if 
an approaching object at the present point in time intersects only a future lying extrapolation 
point t x probability of space occupancy of the doors. 

[0015] For locationally fixed resting objects or for a resting vehicle, the probability 

space, that is, the possible occupation space, is the same as the instantaneous position or as the 
case may be the actual occupation space. For the doors of a resting vehicle, the pivot area of the 
doors themselves is set as the probability space. 

[0016] For determining a collision danger, the already predicted possible occupation 

spaces of an object or as the case may be the vehicle, and the pivot areas of its doors, are taken 
into consideration. In a moving vehicle, advanced warning can be made of objects, which will 
possibly soon enter into the pivot area of the doors. In the case of resting objects, the driver of a 
moving vehicle can be warned of a danger of collision, even before a vehicle reaches a position 
in which the object extends into the operating space, or as the case may be, the pivot area of the 
vehicle doors. This has the advantage, that the object at the point in time of a possible collision 
need not be directly detected by the environmental sensors. It is thus not necessary to detect the 
space adjacent to the vehicle. Thus, sensors already present in the vehicle, such as, for example, 
proximity sensors of the parking aid in the bumpers, can be employed. These sensors can be 
incorporated centrally and in the corners of the bumpers, directed forwards or as the case may be 
directed rearwards. 

[0017] In a preferred environment of the invention, a danger of collision exists when the 

overlapping of the probability space is maintained for a certain period of time. Thereby the error 
tolerance of the process can be influenced. 
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[0018] Preferably, the probability spaces for the vehicle and for the objects are formed 

from their predicted movement paths and their probable boundary curves. Since the actual track 
of the vehicle and the detected objects can deviate from the predicted movement path with 
increasing prediction time, a space is defined about the movement path, which is determined by 
two boundary lines. The boundary lines exhibit a spacing oriented orthogonal to the extrapolated 
path, which is computed from the distance or as the case may be the extrapolation time, by 
multiplication with a certain object-dependent factor. 

[0019] For determining the probability space for the vehicle, for the pivot areas of the 

doors and for the objects, the boundary lines are transformed to the respective outer corner edges 
of the vehicle, the pivot area of the doors, or the objects. Thereby respectively the right 
boundary line is transmitted to the right corner of the vehicle and the left boundary curve to the 
left corner. The width for each possible point in time, a possible position of the object and the 
vehicle, or as the case may be the pivot area of the doors, be indicated. In this manner, a 
probable total occupation space can also be determined, which extends over the entire 
extrapolation time. 

[0020] Preferably, the warning is emitted prior to a possible collision, if the vehicle is 

stopped or moves with a slow vehicle speed below a threshold value and when at the same time 
the object in interest within a certain period of time enters into the possible pivot area of the 
vehicle doors, that is, in the probability space of the doors. Therewith a warning can be reliably 
made regarding approaching objects. If these objects are however still far enough away from the 
possible or actual stopping position of the vehicle, no warning signal must be produced, since 
direct danger of a collision does not exist. 

[0021] The reaction signal can trigger an acoustic or optical warning, when the opening 

of a door is initiated or when the door is opened. An opened door is recognized for example by 
the contact switch which also turns on and off the vehicle interior or dome lights. The initiation 
of the door opening can be indicated by the same sensor which is already employed today for the 
function "keyless go" in the outer door handle. Beyond this, a preferred door opening can also 
be detected by capacitance sensors in the door handle or by sensors which detect the actuation of 
the door handle. 
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|0022] The reaction signal can be emitted as an acoustic signal in a loud speaker in the 

vicinity of the door in interest, which produces a selective localized warning. The warning can 
also occur over the loud speaker of the radio. One possible optical warning is indicated by 
warning lights, which can be located for example in the dashboard. A haptic warning can occur 
via a vibration producer in the door or in the vicinity thereof, for example a vibration producer, 
which allows the door handle to be vibrated, similar to the vibration alarm of a cell phone. 

[0023] Particularly preferred is when the reaction signal can control the door lock, such 

that the corresponding door, for which a collision danger has been recognized, is locked at least 
for a certain period of time. An opening of the door is then possible following a certain time 
delay. The corresponding door could however also remain locked as long as the danger of 
collision exists. An opening of the door from the outside can likewise either be blocked by the 
reaction signal or could be generally unimpeded. 

[0024] Further preferred is limiting the opening angle of the relevant door. The door can 

then only be pivoted to the extent that a collision with an object in the pivot range of the door is 
precluded. For limiting the opening angle, mechanisms and processes known in the state of the 
art can be employed. 

[0025] The inventive process is preferably only carried out then, when the vehicle speed 

is below a certain value, or when it is recognized, that a door is to be opened. A continuous 
sensing of the environment of the vehicle, and the determination and the extrapolation of 
movement paths, is not necessary. 

[0026] Beyond this it is advantageous, when the process can be switched off manually by 

the driver. Further, the inventive process should not be carried out in the case that the vehicle is 
locked from the outside or when it is recognized, that no person is inside the vehicle. In the case 
that the speed exceeds a predetermined speed, the process is likewise not carried out. 

[0027] If a danger of collision no longer exists, that is, no obstacle is in the possible pivot 

area of the door, the output of the reaction signal ends. This would be the case, when a moving 
object no longer represents a potential danger at a point in time within the extrapolation time, or 
when the vehicle moves out of the area of danger of a stationary or a mobile object. 
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[0028] In accordance with the invention, the present task is solved by a device for 

avoiding collisions when opening vehicle doors with a collision monitoring unit. The collision 
monitoring unit includes an evaluation unit, which recognizes objects in the environment of the 
vehicle from sensor data of the environment sensors, and determines movement paths for the 
detected objects. The evaluation unit determines the movement path of the own vehicle from 
sensor data provided by vehicle sensors. The collision monitoring system further includes a 
micro-processor which is adapted to compute a probability space for the vehicle and for the 
detected objects from the respective movement paths, and to recognize an overlapping of the 
probability spaces. The micro-processor provides a reaction signal to indicate a danger of 
collision to the warning means when an overlapping has been determined, 

[0029] The inventive device receives input from sensors present in the vehicle such as 

environment sensors and vehicle sensors. As warning means, loud speaker or warning lights 
could be considered, which likewise could pre-exist in the vehicle. The evaluation unit as well 
as the micro-processor are, as a rule are, connected via a bus system with the environment 
sensors, that is, the ultra-sound sensors, radar sensors or infra-red sensors or cameras. Further, 
the sensors of the vehicle sensors are connected to the bus. Beyond this, further sensors can also 
be connected, for example, sensors that recognize the opening of a door. The micro-processor 
can also provide a further signal to the door locking unit, in order for example to prevent an 
opening of the door for at least a pre-determined period of time. Also, by the provision of a 
suitable signal, the angle of opening of the door can be limited. 

[0030] Preferably, the collision monitoring system is designed to use the sensor data of 

the past and to extrapolate the determined movement path for a certain period of time into the 
future. This can also be carried out by the evaluation unit or by a micro-processor. 

[0031] In a preferred embodiment of the inventive device, the collision monitoring unit is 

activated as soon as the vehicle falls below a pre-determined speed or as soon as the opening of a 
door is recognized. This can also be recognized by suitable sensors or by the door contacts. 

[0032] Preferably, the collision monitoring device is switched off as soon as the vehicle 

exceeds a pre-determined speed. Alternatively, the collision monitoring unit can be switched off 
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manually. The collision monitoring system can also be deactivated as soon as the vehicle is 
locked from outside. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

[0033] A preferred embodiment is explained in greater detail on the basis of the 

following figures. There is shown in: 

[0034] Fig. 1 a schematic representation of an object and a probability space, 

determined from its movement path; 

(0035] Fig. 2 a schematic representation of a vehicle and the probability space of the 

vehicle doors; 

[0036] Fig. 3 a schematic representation of a vehicle and a moving object as well as a 

possible collision space; and 

[0037] Fig. 4 a block diagram of the inventive device for collision avoidance. 
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DETAILED DESCRIPTION OF THE INVENTION 



[0038] In Fig. 1 an object 1 is shown at time to, which is moving in a straight line. From 

the movement of the object 1 a movement path 2 is determined and extrapolated to a pre- 
determined time t x . Since the course of the movement path 2 is not certain between to and t x , two 
movement probability curves 2a, 2b are formed with an angle, which brackets the movement 
path 2. The orthogonal distance of the movement curves 2a, 2b from the movement path 2 at 
time t x is produced from a constant factor multiplied by the time t x . Therewith, the boundary 
curves 2a 2b and the orthogonal distance at time t x describe a equilateral triangle, of which the 
height is formed by the movement path 2. 

[0039] The boundary curves 2a 2b are then projected upon the end point of the object 1. 

In this manner, a total probability space 3 ? between time to and t x is spanned. The total 
probability space 3' reflects for all points in time in the interval to through t x the possibility and 
expected position of the object 1. Therewith possible occupation locations of the moving object 
1 in the relevant time interval can be predicted. At a particular point in time ti there is produced 
therewith the probability space 3 for the object 1. 

[0040] Fig. 2 shows a schematic representation of a vehicle 4 with four doors. Each of 

the doors exhibits a pivot area 5, which is shown for illustrative purposes only for the front right 
door. For the moving vehicle 4 the movement in the past up to time to can be used to extrapolate 
a movement path 6. According to the manner of proceeding in Fig. 1, the boundary curves 6a, 
6b of the movement path 6 can be determined. The projection of the boundary curves 6a, 6b 
onto the pivot area 5 of the front right door leads to the determination of a probability space 7. 
This represents the possible and expected pivot area of the right door at a future time ti. If for tj 
an object is determined in the probability space 7 by the environment sensors of the vehicle 4, 
then a possible collision danger is recognized and in accordance with the inventive process a 
warning is emitted. 

[0041] Fig. 3 shows a situation with a resting vehicle 4 and an opened right front door, 

which is characterized by pivot space 5. The object 1 is moving towards the vehicle. From the 
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extrapolated movement path 2 the total probability space 3* of the object 1 is determined, which 
represents the sum of all possible occupation spaces of the object 1 in the interval to through t x . 
The probability space 3 of the object 1 at a certain point in time ti overlaps partially with the 
pivot area 5 of the right side door of the vehicle 4. This overlapping area represents a possible 
collision area 8, from which in advance a danger of collision is recognized. A direct detection of 
the pivot space 5 by sensors is thus not necessary. Already from the determination of the 
probability space 3 and the collision area 8, a possible collision can be extrapolated. According 
to the inventive process, following the recognition of the collision area 8, a reaction signal is 
emitted, which could be an acoustic warning signal. Alternatively, the opening of the door of the 
vehicle 4 can be prevented or the pivot range 5 of the door can be so limited, so that the door 
cannot be pivoted out into the collision area 8. 

[0042 J A collision monitoring unit 9 according to Fig. 4 includes an evaluation unit 10a 

and a micro-processor 10b. The collision monitoring unit 9 is connected via a bus system 11 
with a sensor control device 12 and a control unit 13. Environment sensors 14 and, vehicle 
sensors 15 are directly connected with the sensor control device 12. The sensor control device 
12 receives the sensor data and conveys this to the evaluation unit 10a. In the evaluation unit 
10a the sensor data are used for determining the movement path for the vehicle as well as the 
objects recognized via the environment sensors 14. The micro-processor 10b extrapolates the 
movement path up to a pre-determined time and determines the probability space for the vehicle 
as well as for the detected objects. If a collision danger is recognized, the micro-processor 10b 
provides via the bus system 11a reaction signal to the control unit 13. This selectively produces 
an acoustic signal, which is emitted via a loud speaker 16. The control unit 13 is also connected 
to a door lock system 17. If a reaction signal from the micro-processor 10b is present, then the 
control unit 13 selectively also relays a signal to the door lock system 17, so that the unlocking 
of the door is blocked at least for a pre-determined period of time. In an advantageous manner, 
the collision monitoring unit is in communication with a bus system, via which data regarding 
position, size and/or number of doors is provided. The bus system could be for example a CAN 
bus system. 

[0043] A particularly advantageous embodiment includes a warning device for traffic 

participants in the environment of the vehicle. Thereby it is envisioned, that the other traffic 
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participants are alerted to the possible opening of the door by optical (for example, blinkers or 
headlamp flashers) or acoustic (for example, signal horn) warning signals in the case of an 
imminent or already underway car door opening, if at the same time the collision monitoring unit 
has recognized a danger of collision. Therein, it is advantageous if the light and/or the acoustic 
signals can be attenuated in their intensity depending upon the degree of the danger of collision. 
If possible, the projection of the signal should be localized depending upon the doors which are 
being opened. 

[0044] Now that the invenetion has been described, I claim the following: 
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